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Abstract. In this paper we give an algorithm to recognize triangulable lo- 
cally nilpotent derivations in dimension three. In case the given derivation is 
triangulable, our method produces a coordinate system in which it exhibits a 
triangular form. 



1. Introduction 

Let /C be a commutative field of characteristic zero, )O n ' be the ring of poly- 
nomials in n variables with coefficients in K, and Aut/c(lC^) be the group of K-- 
automorphisms of ]O n '. Let X — X\ 2 ■ • • ; X yi be a coordinate system of K\ n >, i.e., 
/CM = K,[x\, . . . ,x n ]. Then any automorphism a 6 Autjc()C^) is uniquely deter- 
mined by the images o~(xi), . . . ,a(x n ). The affine subgroup of Aut/c(K.^ n \ x) with 
respect to x is defined as 

Af K (IC^,x) = {a; deg^)) = 1, i = l,...,n}. 

The triangular subgroup of Aut^iJC^) with respect to x is defined as 

BA K (K}- n \x) = {a : cr(x,) = a t Xi + f(x\, . . . , Xi-i) , a t G K.*, i = 1, . . . , n}. 

The tame subgroup of Autjc(IC^) with respect to x is the subgroup generated by 
affine and triangular automorphisms, and is denoted by TA/c(K^ n \x). Automor- 
phisms which belong to TA)c(K\ n \ x) are called tame, and those which are not tame 
are called wild. 

Automorphisms of K.^ are well understood. They are all tame and Autjc(K) 2 }) 
is the free amalgamated product of Afx.{K\ 2 \ x\, x?) and BAx,{KP , \x\,X2) along 
their intersection But so far AutjcQC^) remains a big mystery for n > 3, 

and it is only recently that the existence of wild automorphisms was established 

In order to understand the nature of Autic(IC^) it is natural to investigate 
algebraic group actions on the affine n-space over /C. Actions of the algebraic group 
(AC, +) are commonly called algebraic G a -actions, and are of the form exp(tX) t <£jc 
where X is a locally nilpotent AC-derivation of the polynomial ring /CM. 

A locally nilpotent AC-derivation X of K[x\ is called triangular in the coordinate 
system x if for any i = 1, . . . ,n we have X(xi) € K\x\, . . . , This is equivalent 

to the fact that its one-parameter group exp(t<Y) te ^ is a subgroup of BA/c(IC^ n \x). 
The AC-dcrivation X is called triangulable if there exists a AC- automorphism a of 
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K\ n ' such that aXa 1 is triangular in the coordinate system x, i.e., there exists a 
coordinate system u in which X has a triangular form. 

A natural question is to decide whether a given locally nilpotent /C-derivation 
is triangulable. Bass was the first to give in || an example of non-triangulablc 
locally nilpotent derivation in dimension 3. Bass' construction was generalized 
by Popov in pq] to obtain non-triangulable locally nilpotent derivations in any 
dimension n > 3. A necessary condition of triangulability, based on the structure 



of the variety of fixed points, is also given in |26|. However, this condition is not 
sufficient as proven in |{J . Other criteria of triangulability in dimension 3 are given 
in |l7], [l^, ^ But it is nowhere near obvious to make them working in an 

algorithmic way. 

The aim of the present paper is to develop an algorithm to check whether a 
given locally nilpotent derivation X of K,[x,y,z] is triangulable, and if so to find a 
coordinate system u,v,w in which X has a triangular form. 

The paper is structured as follows. In section |^ we recall the basic facts on 
locally nilpotent derivations and coordinates to be used in the paper. In section |jj 
we give an algorithmic characterization of rank two locally nilpotent derivations in 
dimension three. A triangulability criterion is given in section [|, while section |^ 
contains the main ingredients that make this criterion work in an algorithmic way. 
Computational examples top off the paper. 

2. Notation and basic facts 

Throughout this paper /C is a commutative field of characteristic zero, all the 
considered rings are commutative of characteristic zero with unit and all the consid- 
ered derivations are nonzero. A derivation of a /C-algebra A is called a /C-derivation 
if it satisfies X{a) = for any a£K. 

2.1. Coordinates. A polynomial / e /C[xi, . . . ,x n ] is called a coordinate if there 
exists a list of polynomials fx, . . . , f n -i such that lC[x±, . . . , x n ] = K\f, fi, . . . , / n -i]- 
A list /i, . . . , f r of polynomials, with r < n, is called a system of coordinates if there 
exists a list / r +i, . . . , f n of polynomials such that K,[xi, . . . , x n ] = IC[fi, ...,/„]. A 
system of coordinates of length n will be called a coordinate system. 

The Abhyankar-Moh Theorem |jj states that a polynomial / in K\x, y] is a coordi- 
nate if and only if K[x, y]/ f is AC-isomorphic to A^ 1 '. In the case of three variables 
we have the following result proved by Kaliman in for the case K, = C and 
extended to the case of arbitrary commutative fields of characteristic zero in fTlfl . 

Theorem 2.1. Let f be a polynomial in IC[x,y,z] and assume that for all but 
finitely many a £ K. the K-algebra JC[x, y, z]/(f — a) is ^-isomorphic to ]Q 2 ' . Then 
f is a coordinate of K,[x,y, z]. 

A given polynomial / of K[xi, . . . ,x n ] is called a local coordinate if it satisfies 
fc(f)[ x i, ■ ■ ■ , x n] —Klf) A^(/)'™ -1 '. As a consequence of Theorem 2.1, any local co- 



ordinate of K[x, y, z] is in fact a coordinate, see JL3J. The original proof of Theorem 
[2.l| is of topological nature, and it is not clear how to compute polynomials g, h 
such that K\f, ,g, h] = K\x, y, z\. 

The study of coordinates in polynomial rings over fields naturally leads to do 
the same but over rings. Given a ring A and / £ A[x\, . . . , x n ], we say that / is a 
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residual coordinate if / is a coordinate of /Gp[xi, . . . , x n ] for any prime ideal V of 
A, where IC-p stands for the residual field of A in V . The following result, proved in 
(6) for the Noetherian case and extended to the general case in (is) , will be crucial 
for our purpose. 

Theorem 2.2. Let A be a ring containing Q. Then any residual coordinate of 
A[x,y] is a coordinate of A[x, y] . 

2.2. Locally nilpotent derivations. A derivation of a ring A is called locally 
nilpotent if for any a G A there exists a positive integer n such that X n (a) = 0. 
The subset {a G A ; X(a) = 0} of A is in fact a subring called the ring of constants 
of X and is denoted by A x . When A is a domain and X is locally nilpotent, the 
ring of constants A x is factorially closed in A, i.e., if a G A x and a = be then 
b, c G A x . In particular the units of A are in A x and the irreducible elements of 
A x are irreducible in A. 

An element s of A satisfying X(s) ^ and X 2 (s) = is called a local slice of A". 
If moreover X{s) = 1 then s is called a sZice of X . A locally nilpotent derivation 
needs not to have a slice but always has a local slice. The following result, which 
dates back at least to |30| , concerns locally nilpotent derivations having a slice. 

Lemma 2.3. Let A be a ring containing Q and X be a locally nilpotent derivation 
of A having a slice s. Then A = A x \s\ and X = d s . 

Locally nilpotent derivations in two variables over fields are well understood. We 
have in particular the following version of Rentschler's Theorem J27j] . 

Theorem 2.4. Let X be a locally nilpotent IC-derivation of K,[x,y\. Then there 
exists a coordinate system f,g of IC[x,y] and a univariate polynomial h such that 
K[x,y] x = fC[f] andX = h{f)d g . 

As a consequence of Theorem ^4|, if A is a UFD containing Q and X is a locally 
nilpotent yl-dcrivation of _4[x,y] then there exists / G and a univariate 

polynomial h such that A[x, y] x = A[f] and X = h(f )(d y fd x — d x fd y ), see 110 1 
In case A is an arbitrary ring, the situation is much more involved, see e.g., 
However, we have the following result from [^J. 

Theorem 2.5. Let A be a ring containing Q and X be a locally nilpotent A- 
derivation of A[x,y] such that 1 G T{X{x) 1 X{y)). Then there exists a polynomial 
f such that A[x, y] x = A[f] and X has a slice s. Ln particular, A[x,y] = A[f, s] 
and X = d s . 

In case A = K.^ we have the following result proved by Miyanishi (2^] for the 
case K, = C and extended to the general case in a straightforward way by using 
Kambayashi's result |22| , see also |8| for an algebraic proof. 

Theorem 2.6. Let X be a locally nilpotent JC-derivation of IC[x, y, z] . Then there 
exist f, g G IC[x,y, z] such that K.[x,y,z] x = K[f,g\. 

2.3. Rank of a derivation. Let X be a /C-derivation of )C[x] = K.[xi, . . . , x n ]. As 
defined in the co-rank of X, denoted by corank(X), is the unique nonnega- 
tive integer r such that /Cfx]'*' contains a system of coordinates of length r and 
no system of coordinates of length greater than r. The rank of X, denoted by 
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rank(X), is defined by rank(X) = n — corank(X). Intuitively, the rank of X is 
the minimal number of partial derivatives needed for expressing X. The only one 
derivation of rank is the zero derivation. Any /C-derivation of rank 1 is of the 
form . . . , f n )9f„ ■ where /i, ...,/„ is a coordinate system. Such a derivation 
is locally nilpotcnt if and only if p does not depend on /„ . 

Let X be a locally nilpotent /C-derivation of JC\x\ and let us consider c = 
gcd{X(xi), . . . , X(x n )). We say that X is irreducible if c is a constant of /C*. It is 
well known that X(c) = and X = c~y where y is an irreducible locally nilpotent 
/C-derivation. Moreover, this decomposition is unique up to a unit, i.e., if X = CijVi, 
where 3^1 is irreducible, then there exists a constant (i S K,* such that c\ = \ic and 

y = v&i. 

Given any irreducible locally nilpotent /C-derivation of K[xi, . . . , x n ] and any c 
such that X{c) = 0, the derivations X and cX have the same rank. Thus, for rank 
computation we may reduce, without loss of generality, to irreducible derivations. 
We will see in section |^ that the rank of a locally nilpotent derivation in dimension 
three may be computed by using classical techniques of computational commuta- 
tive algebra, namely Grobner bases and functional decomposition of multivariate 
polynomials. 

2.4. The plinth ideal and minimal local slices. Let A be a ring, A" be a locally 
nilpotent derivation of A and let 

S x := {X(a) ; X 2 (a) = 0}. 

It is easy to see that S x is an ideal of A x , called the •plinth ideal of X. This is 
clearly an invariant of X, i.e., S crXa ' = <r(S x ) for any automorphism a of A. In 
case A = K.[x,y,z] we have the following result which is a direct consequence of 
faithful flatness of /C[x, y, z] over K.[x, y, z] x , see [[ll] for the general case. 

Theorem 2.7. Let X be a locally nilpotent K-derivation of K.[x,y, z]. Then the 
plinth ideal S x is principal. 

Computing a generator of the ideal S x is of central importance for our purpose. 
For this we need the concept of minimal local slice which may be found in ^ . 

Definition 2.8. Let A be a domain and X be a locally nilpotent derivation of A. 
A local slice s of X is called minimal if for any local slice v such that X(v) \ X(s) 
we have X(v) = fiX(s), where /i is a unit of A. 

Lemma 2.9. Let A be a UFD, X be a locally nilpotent derivation of A and s be a 
local slice of X . Then the following hold: 

i) there exists a minimal local slice sq of X such that X(so) \ X(s), 

ii) in case S x is a principal ideal, it is generated by X(s) for any minimal local 
slice s of X . 

Proof, i) Let s be a local slice of X and write X(s) = fip" n ■ ■ -p™ r , where (x is 
a unit and the p^s are prime, and set m = Xli TO i- We will prove the result by 
induction on m. 

For m = we have X(s) = fi, and so ^ _1 s is a slice of X. This shows that s is a 
minimal local slice of X. Let us now assume the result to hold for m — 1 and let 
s be a local slice of X, with X(s) = fip" 11 ■ ■ -p™ T and ^ m, = m. Then we have 
one of the following cases. 
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- For any i = 1, . . . , r the ideal pi.A does not contain any element of the form s + a 
with X(a) = 0. In this case s is a minimal local slice of X. Indeed, if it is not 
the case there exists a local slice so of X such that X(s) = qX(so), where q is not 
a unit of A x '. Without loss of generality we may assume that pi | g. If we write 
g = p\qi then «Y(s — qiPi-so) = and so the ideal piA contains an element of the 
form s + a with X(a) = 0, and this contradicts our assumption. 

- There exists i such that piA contains an element of the form s + a, with X(a) = 0. 
Without loss of generality we may assume that i = 1. If we write s + a = p\S\ then 
X(si) = /ip r [ L1 ~ 1 p™ 2 ■ ■ -p™ r , and by using induction hypothesis we get a minimal 
local slice sq of X such that X(sq) \ X(si). Since X(si) \ X(s) we get the result in 
this case. 

ii) Assume now that S x is principal and let c be a generator of this ideal, with 
c = X(sq). Let s be a minimal local slice of X. Since X(s) G S x we may write 
X{s) = /iA"(,so). The fact that s is minimal implies that /i is a unit of ■4'^, and so 
A" (s) generates S x . □ 

An algorithm for computing a generator of S x in dimension three is given in Q . 
As wc will see in section [|, a generator of the ideal S x contains crucial information 
for computing the rank of a locally nilpotent derivation in dimension three. 

Let A x [s ; X{s) £ S x ] be the subring of A generated over A by all the 
local slices of X . This is another invariant of the derivation X . Let (cj)ig/ be a 
generating system of S x and let Si be such that X{si) = Cj. Given any local slice 
s of ^ we have .-f(s) G and so there exist a finite subset J of / an a family 
in such that ^(s) = ^\ UiX(si). We have then X(s — J2 i UiSi) — and 
so s e A x [si,i G /]. This proves that the ring A x [s ; X(s) G S*] = ^[s^z G I]. 
In case iS^ is principal we get a univariate polynomial ring ^^[s], which we will 
call the trivializing ring of X and denote by T x . 

Assume A to be a UFD and that S x is principal and generated by c = X(s). For 
any factor q of c we let I x = qA H T x [si . The ideals 2^ are in fact invariants of 
the derivation and we will see in section H that they hold the essential information 
needed to decide whether X is triangulable. 

3. Characterization of rank two locally nilpotent derivations 
Let X be an irreducible locally nilpotent derivation of IC[x,y,z] and c be a 



generator of its plinth ideal S . From Lemma 2.3, X is of rank 1 if and only if 
c G KL* . The following Theorem from Q gives a characterization of rank two locally 
nilpotent derivations in dimension three. 

Theorem 3.1. Let X be an irreducible locally nilpotent derivation oflC[x,y,z] and 
assume that rank(X) ^ 1. Let us write IC[x,y,z] x — K,[f, g] and S x = clC[f,g}. 
Then the following are equivalent: 

i) rank(X) = 2, 

ii) c — £(u), where £ is a univariate polynomial and u is a coordinate of K[f,g\, 
Hi) c = £{u), where u is a coordinate of JC[x,y,z]. 

Proof, i) => ii) Assume that rank(X) = 2 and let u,v,w be a coordinate system 
such that X{u) = 0. The /C-derivation X is therefore a K,[u] -derivation of /C[m][w, w], 
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and since JC[u] is a UFD there exists p G K,[x, y, z] such that IC[f, g] = K.[u,p]. This 
proves that u is a coordinate of /C[/, g]. 

Let us now view X as /C(u)-derivation of JC(u)[v,w]. Since X is irreducible, and 

Jctuj 



according to Theorem 2.4, there exists s — such that X(s) = 1, and so 



X(h) = k(u). Let c be a generator of S . Then c | k(u), and since K,[u] is 
factorially closed in K,[u,v,w] we have c = £(u) for some univariate polynomial I. 

ii) => Hi) Assume that c = £(u), where u is a coordinate of K,[f,g] and write 
^-[/iff] = fc[ u ,p\- Let s be such that X(s) = c. If we view X as /C(u)-derivation of 
JOu)[x,y, z] then K.(u)[x, y, z\ x = /C(u)[p] and X(c~ 1 s) = 1. By applying Lemma 
^3] wc get lC(u) [x, y, z] = K.(u)\p,s]. From Theorem ^ we deduce that u is a 
coordinate of K,[x, y, z\. 

Hi) => i) Since rank(X) ^ 1 the polynomial £ is nonconstant. We have X(c) = 
£'(u)X{u) = 0, and so X(u) = 0. On the other hand, since u is assumed to be a 
coordinate of lC[x, y, z] we have rank(X) < 2. By assumption we have rank(X) =/= 1 
and so rank(X) = 2. □ 



The condition ii) in Theorem 3.1 is in fact algorithmic. Indeed, there are ac- 
tually many algorithms to check whether a given polynomial in two variables is a 
coordinate, see e.g., ||, O, [291. It is worth mentioning that from the complexity 
point of view the algorithm given in |^9| is the most efficient as reported in p4j . 
On the other hand, condition c = £{u) may be checked by using a special case, 
called uni-multivariate decomposition, of functional decomposition of polynomials, 
see e.g., [fl9| . It is important to notice here that uni-multivariate decomposition is 
essentially unique. Namely, if c = £(u) = £±(ui), where u and iti, are undecom- 
posable, then there exist ji G K* and v G K such that u\ = fiu + v. More details 
about the computation of the rank of a locally nilpotent derivation in dimension 
three may be found in [Q. 

4. A TRIANGULABILITY CRITERION 

Triangulable derivations in dimension n are of rank at most n—1. On the other 
hand, a rank 1 locally nilpotent derivation is obviously triangulable. This shows 
that in dimension 3 we only need to deal with rank 2 derivations. 

Let X be a rank 2 locally nilpotent derivation of /C[x, y, z] such that X(x) = 0. Then 
for any coordinate system X\,y\,Z\ such that X{x\) = we have IC[x] = JC[xi], 
sec H (this could also be easily deduced from the uniqueness property of uni- 
multivariate decomposition). This proves that if X has a triangular form in a 
coordinate system xi,yi,z% then x\ is essentially unique and may be extracted 
from a generator of the plinth ideal S x . Also, this shows that if X is triangulable 
and X(a) = then aX is triangulable if and only if a G K\x\. 

Lemma 4.1. Let X be an irreducible locally nilpotent IC-derivation of IC[x,y, z] of 
rank < 2, u be a coordinate of IC[x,y,z] such that X{u) = 0, and s be a minimal 
local slice of X. Then the IC[u\- derivation y = JaC( 2 , i j, iZ )(u, s, .) is locally nilpotent 
irreducible and K,[x, y, z]^ = IC[u, s]. Moreover, Xy = yX . 

Proof. Without loss of generality, we may assume that u = x. Let us write 
IC[x,y, z] = IC[x,p] and let X(s) = c(x). Then /C[a;] c [y, z] = K.[x] c [p,s] according 
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to Lemma 2.3. Given a 6 1C[x, y, z], we may therefore write a = ^fc 3 ^ ■ This gives 



3^(a) = —c~ n (d z sd y p — dysd z p)d p h, and since A'(s) = —d z sd y p + d y sd z p = c(x) we 
get = c(a;)~ n+1 <9p/i. By induction we get y d+1 (a) = 0, where d = deg (h), 

and this proves that y is locally nilpotent. 

Let g{x,y,z) = gcd{d y s,d z s). Since 3^(p) = — c{x) we have g \ c(x) and so we 
may write c(x) = g{x)c\{x). We have then s(x,y,z) = g(x)s\(x,y, z) +a(x), and 
this gives X(si) — c\{x). Since s is a minimal local slice of X we have c{x) \ c\{x), 
and so j e K.*. This shows that y is irreducible. 

Let us write IC[x, y, z] y = IC[x, sq] and s = £(x,so). Then y = £' (x, so)(d z sod y — 
d y sod z ). Since y is irreducible £' is a unit, and so s = (xsq + a(x). This proves that 
/C[x, so] = tC[x, s]. The fact that X and 3^ commute is clear. □ 

Lemma 4.2. Let X be a rank two irreducible triangulable IC- derivation oflC[x,y, z] 
and let u,v,w be a coordinate system of JC[x,y,z] such that 

X{u) = 0, X{v) = d(x), X(w) = q(x, v). 

Let c{u) be a generator of S . Then d(u) = c(u)e(u), gcd(c(w), e(u)) = 1 and 
X(e(w), q(u, v)) = K\u, v]. 

Proof. Since X is of rank 2 we must have d(u) ^ 0, and so v is a local slice of X. 
This proves that c(u) \ d(u). On the other hand, let us consider 

(4.1) p = d(u)w-q 1 (u,v), 

where d v q\ = q. We have X = d w pd v — d v pd w , and the fact that X is irreducible 
implies that gcd(d v p,d w p) = 1. This shows that IC[u, v, w] x = IC[u,p\. 

Let us write d(u) — c(u)e(u), and notice that the result obviously holds if we have 
deg u (e(w) = 0. Thus, we assume in the rest of the proof that deg u (e(M)) > 0. 

Let a be a root of e(u) in an algebraic closure IC of IC and let us prove that q(a, v) 
is a nonzero constant. We may write 

(4.2) v = e(u)s(u, v, w) + £(u,p(u, v, w)), 



where s is a minimal local slice of X. By substituting a to u in the relation (4.2) 



we get v = £{a,p(a,v,w)), and by doing so for (4.1) we get p(a,v,w) = —qi(a,v). 
This yields v = £(a, —qi(a, v)). By comparing degrees in both sides of this equality 
we get deg(<ji(a, v)) = 1. This proves that deg(g(a,w)) = and so q(a, v) is a 
nonzero constant. By the Hilbert Nullstcllensatz we have T(e(u), q{u, v)) = IC[u, v]. 
To prove that gcd(c, e) = 1 we only need to show that q(a,v) is nonconstant for 
any root a of c(u). 

Let a{u) be a prime factor of c(u). First, notice that the assumption q(u,v) = 
mod a(u) would imply that a(u) \ X(h) for any h and contradicts the fact that 
X is irreducible. Assume towards contradiction that q{u, v) is a nonzero constant 
modulo a(u). Then X has no fixed points in the surface a(u) = 0. If we write c{u) = 
a{u) m ci{u), with gcd(ci,a) = 1, and view X as /C[u] Cl -derivation of /C[m] Ci [v, w] 



then it is fixed point free and so it has a slice s according to Theorem 2.5. If 
we write s = / ^"'"'"'- ) then X{h) = cJ{. But c™ is not a multiple of c, and this 

contradicts the fact that c is a generator of S x . □ 
The following Lemma shows that it is possible to get rid of the factor e(u). 
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Lemma 4.3. Let X be a rank two irreducible triangulable locally nilpotent K,- 
derivation of K\x, y, z], and write K.[x,y,z] x = K.[u,p] where u is a coordinate 
of IC[x,y, z]. Let s be a minimal local slice of X and write X(s) = c(u). Then there 
exist v,w such that u,v,w is a coordinate system and 

X{u) = 0, X(v) = c(u), X{w) = q{u,v). 

Proof. Let Ui,Vi,W\ be a coordinate system such that X{u\) = 0, X{v\) = d{u\) 
and X(w\) = q\{u\, V\). Without loss of generality we may assume that u\ = u, 



and according to Lemma 4.2 let us write d(u) = c(u)e(u) with gcd(c(w), e{u)) = 1. 

Without loss of generality, we may choose p = c(u)e(u)w\ — Qi{u,v\), where 
d Vl Qi = qi, and v\ = e(u)s + £\(u,p). This gives the relation 

(4.3) p = c{u)e(u)wi - Qi(u 7 e(u)s + £i(u,p)). 
If we write a(u)c(u) + b{u)e{u) = 1 then we get 

Qi(u, e(u)s + li{u,p)) — Qi(u, e(u)(s + b(u)£i(u,p)) + c(u)a(u)£i(u,p)), 
and by Taylor expanding we get 

(4.4) Qi(u, e(u)s + £i(u,p)) = Q 1 (u, e(u)(s + b(u)£ 1 (u,p))) + c(u)Q 2 (u,p, s). 

Now, let £(u,p) = b(u)£i(u,p), v = s + £(u,p), Q(u,v) = Qi(u,e(u)v) and let 
w = e(u)wi — Q 2 (u,p, s). According to the relations fl4.3| ) and ( |4.4[ ) we have 

(4.5) p + Q(u, v) = c{u)w. 



Let us consider the JC[u] -derivation y = — Jac(u, v, .). By Lemma 4.1. y is locally 
nilpotent and IC[x,y,z\^ = K,[u,v\. By the relation ( |4.5| ) we have y(w) = 1, 
and from Lemma ^.3| we deduce that u,v,w is a coordinate system of K\x,y,z\. 
Moreover, we have X{u) = 0, ^(v) = c(u) and X{w) = d v Q(u,v). □ 

We have now enough material to state the main result of this section. 

Theorem 4.4. Let X be a rank two irreducible locally nilpotent IC-derivation of 
JC[x,y, z] and write K.[x,y,z) x = K,[u,p] where u is a coordinate of K.[x, y, z] . Let 
s be a minimal local slice of X and write X(s) = c(u). Then the following are 
equivalent: 

i) the derivation X is triangulable, 

ii) the ideal contains a polynomial of the form H — p + Q(u, s + £(u,p)). 

In this case, if we let v = s + £(u,p) and H = c(u)w then u,v,w is a coordinate 
system of K\x,y, z] which satisfies 

X(u) = 0, X(v) = c(u), X{w) = d v Q(u,v). 

Proof, i) ii) Let u, »,robea coordinate system such that X{u) = 0, X(v) = d{u) 



and X(w) = q(u,v). By Lemma 4.3 we may choose our coordinate system in such 
a way that d(u) = c(u). In this case we have v = s + £{u,p) and we may choose 
p = c(u)w — Q(u,v), where d v Q(u,v) = q(u,v). If we let H = p + Q(u,v) then 
clearly H el?. 

ii) => i) Let v = s + £(u,p) and y = — Jac(w, v, .), and notice that y is locally 
nilpotent and K\x, y, = IC[u, v] according to Lemma |4.l| . By assumption we 
have H = p + Q(u, v) e 1* , so let us write H = c(u)w. Since y(H) = y(p) = c(u) 
we have y(w) = 1. According to Lemma [2.3] , u, v, w is a coordinate system of 
/C[x, y, z], and X(u) = 0, X(v) = c(u) and X (w) = d v Q(u, v). □ 
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Corollary 4.5. Let X be a rank two irreducible locally nilpotent IC-derivation of 
JC[x,y,z] and write K.[x,y, z] = /C[it,p] where u is a coordinate of K,[x, y, z] . Let 
s be a minimal local slice of X and write X(s) = c(u) = c™ 1 ■ ■ • c™ r ; where the Ci 's 
are irreducible and pairwise distinct. Then the following are equivalent: 

i) the derivation X is triangulable, 

ii) for any i = 1, . . . , r the ideal 1 ' n t contains a polynomial Hi such that H L = 
p + Qi{u,s + £i(u,p)) mod c™\ 



Proof, i) =£> ii) This is an obvious consequence of Theorem | 

ii) => i) By the Chinese remainder Theorem let Q(u, v) and £(u,p) be such 
that Q = Qi and £ = li mod c"\ A straightforward computation shows that 
p + Q(u, s + £(u,p)) = c(u)w, and so X is triangulable by Theorem nM □ 



5. Computing a triangulating coordinate system 

Let X be an irreducible triangulable locally nilpotent derivation of IC[x,y,z] 
and write !C[x,y,z] x = K,[u,p], where u is a coordinate of K,[x,y,z). Let s be a 
minimal local slice of X, with X(s) — c{u) = c™ 1 ■ • • c" r and the c;'s are prime 
and pairwise distinct. According to Corollary |4.5| it suffices to find a polynomial 
of the form p + Qi(u,li(u,p)) in each ideal 2/^ . It is trivial to sec that such a 

polynomial is a coordinate of IC[u,p, s], and as a by-product it is a coordinate when 
viewed as polynomial of /C[m]/c" ; [p, s}. We are thus led to deal with the problem of 
finding a polynomial in X c «i which is a coordinate of /CfxJ/c™* [p, s]. In fact, taking 



into account Theorem 2.2, we only need to deal with the case of K\x\/ci[p 1 s]. In 
this section we solve such a problem, and we show how this allows to compute a 
coordinate system of K,[x, y, z] in which X exhibits a triangular form. 

Lemma 5.1. Let X be a rank two irreducible locally nilpotent IC-derivation of 
K,[x,y,z], and write IC[x,y,z] x = K.[u,p] where u is a coordinate oflC[x,y,z]. Let 
s be a minimal local slice of X and write X{s) = c(u). Then for any prime factor 
C\ of c the following hold: 

i) there exists a monic polynomial h\ with respect to s such that T x — (ci,hi). 
Moreover, Ci,h\ is the reduced Grobner basis of T x with respect to the lex-order 
u <p -< s, 

ii) the ideal T x contains a coordinate of JC[u]/ci [p, s] if and only if hi is a 
coordinate of IC[u]/ci[p, s}. Moreover, any polynomial h £ T x which is a coordinate 
of /C[u]/ci [p, s] satisfies h = pb{u)hi, where [i is a unit of K,[u]/ c\. 

Proof, i) Let v,w be such that u,v,w is a coordinate system of lC[x,y, z]. The 
derivation X induces a locally nilpotent /C[ii]/ci-derivation X of K\x,y,z\jc\ = 
IC[u]/ci[v, w]. Since X is assumed to be irreducible we have X ^ 0, and by Theorem 
2.4 there exists t9 £ IC[u)/ci[v, w] such that K\u]/c\ [v, w] x = /C[u]/ci[$]. 

Clearly, K.[u,p,s]/I x is a /C[w]/ci-subalgebra of /C[u]/ci[t>, w] and we have X(p) = 
X(s) = in /C[u]/ci[u, w). This proves that K,[u,p, s]/I x is in fact a K\u\/c\- 
subalgebra of /C[u]/ci[$], and as a consequence there exist polynomials a(t),b(t) £ 
)C[u]/ci[t] such that p = a($) and s = b(d) in K[u}/ci[d\. To prove that a(t) is 
nonconstant we will prove that lC[u,p] f]I x = (ci). Let k(u,p) £ K\u,p] D2 X and 
write k(u,p) — ci(u)pi(u,v,w). Since K,[u,p] is factorially closed in K-[u, v,w] we 
have pi(u, v, w) =p2(u,p), and so k(u,p) = c\{u)p2{u,p). 
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Now if a(t) is constant, say ao(u), then p — ao(u) = in ]C[u]/a[v, w] and so 
p — ao(u) € IC[u,p) nl^. This contradicts the fact that IC[u,p] nl = (ci(it)). 

The fact JC[u,p] DT* = (c\) implies that the polynomial algebra /C[it]/ci[p] is 
a /C[u]/ci-subalgebra of IC[u]/ci[v,w]. Let us write a(t) = a m (u)t rn + ■ ■ ■ + ao(it) 
with m > 1 and a m a unit of K,[u]/ci. The fact that a($) — p = in K,[u]/ci[v, w] 
implies that d is integral over /C[u]/ci[p]. From s = b(d) in K[u]/ci[v, w) we deduce 
that s is integral over /C[u]/ci[p] as well. Since /C[w]/ci[p] is UFD and /C[u]/ci[v, w] 
is a domain there exists a unique irreducible polynomial hi(u,p,t) which is monic 
with respect to t such that hi(u,p, s) = in /C[u]/ci[u, w]. Moreover, any other 
polynomial h(u,p,t) such that h(u,p,s) = in K\v\/c\ [v, w] is a multiple of hi. 
This means exactly that c\K\u,v,w\ f\K[u,p, s] = (ci,h\) and that h\ is unique, 
up to a multiplication by a constant in K\u]/c\, when viewed as polynomial in 
JC[u]/c!\p, s}. 

Now let a e T*, and notice that in this case reducing a by h, with respect to 
the lex-order u -< p -< s, is the same as performing the Euclidean division of a by 
h with respect to s. We may thus write a = qh + r, with deg s (r) < deg s (/i). Since 
r € we may write r = b\h + b^cy^ and even if it means reducing 62 by h we may 
assume that deg s (6 2 ) < deg s (h). By comparing degrees with respect to s in both 
sides of the last equality we get r = 62C1, and so a reduces to by using h, c\. This 
means exactly that c\,h\ is a Grobner basis of I* with respect to the lex-order 
u -< p -< s. 

ii) Let /i £ I* be a coordinate of /C[u]/ci[p, s], and write = ac\ + bh\. Then 
over JC[u]/ci we have h = bh\, and the fact that h is a coordinate of /C[u]/ci[p, s] 
implies in particular that it is irreducible. This shows that 6 is a unit of /C[u]/ci[p, s], 
and so a nonzero clement of the field K,[u]/ci. As a consequence of this, h\ is a 
coordinate of /C[u]/ci[p, s]. The converse is clear. □ 

We can now state the main result of this paper. 

Theorem 5.2. Let X be a rank two irreducible locally nilpotent IC- derivation of 
K.[x,y,z], and let JC[x,y,z] x = K.[u,p] where u is a coordinate of K.[x,y, z]. Let s 
be a minimal local slice of X and write X{s) = c(u) = c™ 1 • • ■ c" r ; where the Ci 's 
are irreducible and pairwise distinct. Then X is triangulable if and only if for any 
i = 1, . . . , r the following hold: 

i) the reduced Grobner basis of I* with respect to the lex-order u -< p -< s is 
Ci,hi, where hi = Qi(u, s + £i(u,p)) + pLi(u)p mod Cj and pbiiu) is a unit mod Ci, 

ii) if£(u,p) is such that £{u,p) =£i(u,p)) mod C£, and v = s + £(u,p) then u,v 
is a system of coordinates of IC[x,y 7 z]. 

In this case the ideal , where y — J&C( X y z }(u, v, .), contains a polynomial of the 
form p + Q(u, s + £{u,p)) and if we let p + Q(u, s + £{u,p)) = c{u)w then u, v, w is 
a coordinate system of IC[x,y, z] which satisfies 

X(u) = 0, X{v) = c{u), X(w) = d v Q(u,v). 



Proof. By Theorem 4.4, the ideal I* contains a polynomial h* of the form 

p + Q*(u, s + £*(u,p)) and if we let v* = s + £*(u,p) and h* = c(u)w* then u, v*, w* 
is a coordinate system of K\x, y, z]. 
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For any i = 1, ...,r, let h*,Q*,£* be respectively the reductions modulo c, of 
h*, Q*,£*. The fact that reduction modulo c, is a /C-algebra homomorphism implies 
that h* = p + Q*{u, s + £*(u,p)) mod Cj. 

Since h* is a coordinate of /C[it][p, s] it is a coordinate of /C[u]/ci[p, s] according to 
Theorem 2.2. By Lemma 5.1 i) let Cj, hi be the reduced Grobner basis of I* with 



respect to the lex-order u <p -< s. According to Lemma 5.1 ii) there exists a unit 
Vi modulo Ci such that h* = Vi(u)hi. If we let be such that /i,^ = 1 mod Cj 

then we have hi = Qi(u, s + £*(u,p)) + fii(u)p, where Qi € fC[u, t]. 

Now let £(u,p) be such that £{u,p) = £*(u,p) mod c; for any i = 1, . . . , r. Since 
£*(u,p) = £*(u,p) mod Cj we also have £(u,p) = £*(u,p) mod Cj. We claim that 
v = s + £(u,p) is a /C[u]-coordinate of K[u,v* ,w*]. Indeed, according to Theorem 



2.2, it suffices to show that v is a coordinate of K\u}/ 'd(u)[v* , w*) for any irreducible 



polynomial d(u) G K\u\. Depending on d(u) we have the two following cases. 

- For some i = 1, . . . , r, d{u) and Ci(u) are associate. In this case we have v = v* 
in K,[u) / d(u)[v* , w*], so v is a coordinate in K.[u]/d(u)[v*,w*]. 

- For any i = 1, . . . , r, gcd(d, Cj) = 1. In this case c(u) is a unit of /C[u]/d(it). Let X 
be the /C[u]/d(u)-derivation of K.[u]/ d(u )[v*, w*] induced by X. Then ^(c" 1 !" ) = 1, 
which proves according to Theorem |2.4| that v is a coordinate of fC[u]/d(u)[v*, w*]. 



Assume that i) and ii) hold and let y = Jac(u,w, .). By Lemma |4.1| , y 
is locally nilpotent and we have K.[u,v* ,w*]^ = K.[u, v]. Moreover, y{p) = —c{u) 
and the fact that v is a coordinate of K\v\ [v*, w*] implies that y has a slice w. We 
therefore have y(p + c(u)w) = 0, and so p + c(u)w = Q(u, v). The fact that u, v, w 



is a coordinate system of K.[x,y,z] follows immediately from Lemma 2.3, and a 
direct computation shows that X has a triangular form in the coordinate system 
u,v,w. □ 

Remark 5.3. Let X be a triangular IC-derivation and write 
X(x) = 0, X(y) = c(x), X{z)=q{x,y) 1 



and let p = c(x)z — Q(u,v) where q = d y Q. From Theorem 5.1 ii) we deduce that 
any v = y + d(u)£(x,p), where d(u) is the maximal square-free factor of c(u), is 
a coordinate and gives rise to another coordinate system x, v, w in which X has a 
triangular form with a different polynomial Q . Thus, a triangulable derivation has 
many, actually infinitely many, triangular forms. It is also not clear whether there 
exists a distinguished form which could serve as a "normal form" . Nevertheless, it 
should be noticed that all the triangular forms and their corresponding coordinate 
systems are built out of invariants of X , namely S x and the ideals I* where the 
Ci 's are the primes factors of c(u). 

Let us now discuss how to computationally check the conditions i) and ii) of 



Theorem 5.2. Assume that condition i) holds and that we have found a polynomial 
of the form p + Qi(u, s + £i(u,p)) in each ideal I*. The computation of £(u,p) is 



then just a matter of Chinese remaindering. On the other hand, from Lemma 4.1 
we know that y = Jac^ x y z ^(u, v, .), where v = s + £(u,p), is locally nilpotent and 
JC[x,y,z\y = K[u, v]. Thus, v is a coordinate if and only if y has a slice. This 
may be checked by computing a minimal local slice starting from the local slice p, 
which reduces to compute a reduced Grobner basis G of c(u)K.[x,y, z] n JC[u,v,p] 
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with respect to the lex-order u -< v -< p. In more explicit terms, v is a coordinate 
if and only if the computed Grobner basis is of the form c(u),p + Q(u,v). Notice 
that in case v is a coordinate. G also furnishes a polynomial w, with p + Q(u, v) = 
c(u)w, which completes u, v into a coordinate system and the polynomial Q which 
is involved in the triangular form of X. 

The condition i) is a matter of functional decomposition of polynomials, and the 
fact that we are here dealing with monic polynomials with respect to s makes it 
almost trivial. 

Lemma 5.4. Let c(u) be an irreducible polynomial of K,[u,v,w], n be a positive 
integer and h G K\u, v, w] be monic with respect to w and write 

h = w d + h d -i{u, v)w d - 1 H \-h (u, v). 

Then the following are equivalent: 

i) h = Q{u, w+£(u 7 v)) in tC{u]/c n {v, w], with I G /C[u]/c"[w] and Q G /C[M]/c n [w;], 

ii) h(u,v,w — hd ~ 1 ), viewed in K,[u]/c n [v,w], is a polynomial of K.[u]/c n [w]. 

In this case, we may choose £ = hd (1 1 and Q = h{u, v, w — £). 

Proof, i) =>■ ii) Let us write Q = w d + qd-\(u)w d ^ 1 + ■ • • + qo(u). By expanding 
Q(u,w + £(u,v)) an comparing its coefficients with respect to w to those of h we 
get hd-i(u, v) = d£(u, v) + qd-i(u). Therefore, h(u, w — ^j 1 ) = Q(u, w — 2±=iM) 
and this clearly shows that h(u,w — hd (1 1 ) G /C[u]/c"[iu]. 

ii) i) Let us write h(u, v,w — hd d 1 ) = Q(u, w). Then Q(u, w + -^-) = h and 
we have the required decomposition. □ 



6. Examples 

In this section we give two examples to illustrate how our algorithm proceeds. 
All derivations are given in a Jacobian form, i.e., as Jac(/, g, .), since in such a form 
one can algorithmically check whether the given derivation is locally nilpotent and 
if so whether its ring of constants is generated by /, g, see Q]. For implementation 
we used the Computer Algebra System Maple release 10. 

Example 6.1. Consider following example from P|. 

fi = x, 

. (xz+y 2 ) 2 

91 = y + - — r^-, 

and let X = 3act XtV Z \(fi,gi, .) = d z g\d v — d y g\d z . The derivation X is locally 
nilpotent and its kernel is IC[fi,gi]. Our algorithm produces —x as a generator of 
the plinth ideal S x and s = — xz — y 2 as a minimal local slice. The computation 
of a Grobner basis of I* with respect to the lex-order x -< g\ ~< s produces then 
x, (s 2 — 4gi) 2 + 16s, and the polynomial (s 2 — 4p) 2 + 16s cannot be written in the 
form pgi + Q(x,s + £(x, gi)), where p, G tC* . Therefore, X is not triangulable. 

Example 6.2. Consider the following polynomials 

f 2 = 2x + y + z 2 -2 zxy + x 2 y 2 , 

92 = 3 xy + 2 x 2 — 2 zx + 2 x 2 y + y 2 — yz + xy 2 + z 2 y + z 2 x — z 3 + 3 z 2 xy— 
2 zxy 2 - 2 zx 2 y — 3 zx 2 y 2 + x 2 y 3 + x 3 y 2 + x 3 y 3 — z 2 + 2 zxy - x 2 y 2 , 
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and let y = JaC( x ,j/,z)(/2) <?2 ; ■)■ ^ e derivation y is locally nilpotent and its kernel 
is K,[f2,g2\- Moreover, our algorithm produces fi as a generator of the plinth ideal 
and s = z — xy+l as a minimal local slice ofy. The computation of a Grobner 
basis oflJ 2 with respect to the lex-order f% ~< g<i -< s produces then fa, s 2 — 2s+<?2+l- 
If we let u = f 2 and v = s — 1 then we get g2 + v = fzW, where w = —y — x + z — xy. 
This gives a coordinate system u, v, w such that 

y{u) = o, y(v) = u,y(w) = 2v. 



References 

S. S. Abhyankar and T. T. Moh, Embeddings of the line in the plane, J. Reine Angew. Math. 
276 (1975), 148-166. 

M. A. Barkatou, H. El Houari, and M. El Kahoui, Characterization of rank two locally 

nilpotent derivations in dimension three, Submitted to J. Algebra (2006). 

H. Bass, A non-triangulable action of G a on A 3 , J. Pure Appl. Algebra 33 (1984), 1-5. 

J. Berson and A. van den Essen, An algorithm to find a coordinate's mate, J. of Symbolic 

Computation 36 (2003), 835-843. 

J. Berson, A. van den Essen, and S. Maubach, Derivations having divergence zero on R[X, Y], 
Israel J. Math. 124 (2001), 115-124. 

S. M. Bhatwadekar and A. K. Dutta, On residual variables and stably polynomial algebras, 
Comm. Alg. 21 (1993), no. 2, 635-645. 

S. M. Bhatwadekar and A. K. Dutta, Kernel of locally nilpotent R-derivations of R.[X,Y], 
Trans. Amer. Math. Soc. 349 (1997), no. 8, 3303-3319. 

A. Crachiola and L. Makar -Limanov, An algebraic vroof of a cancellation theorem for sur- 



faces, Preprint available at http://www.ihes.fr/IHES/Scientifique/Preprint/prepub.php 

(2005). 

D. Daigle, A necessary and sufficient condition for triangulability of derivations of k[X, Y, Z], 
J. Pure Appl. Algebra 113 (1996), no. 3, 297-305. 

D. Daigle and G. Frcudenburg, Locally nilpotent derivations over a UFD and an application 
to rank two locally nilpotent derivations of k[X\,--- ,X n ], J. Algebra 204 (1998), no. 2, 
353-371. 

D. Daigle and S. Kali man. A note on locally nilvotent derivations and variables of k[X, Y,Z], 
preprint available at pttp: //aixl .uottawa. ca/~ddaigle/ 



H. El Houari and M. El Kahoui, Algorithms for recognizing coordinates in two variables over 
UFD 's, Proceedings of ISSAC'2004, ACM Press, 2004, pp. 135-140. 

M. El Kahoui, UFD's with commuting linearly independent locally nilpotent derivations, J. 
Algebra 289 (2005), 446-452. 

A. van den Essen, Polynomial automorphisms and the Jacobian conjecture, Progress in Math- 
ematics, vol. 190, Birkhauser Verlag, Basel, 2000. 

A. van den Essen and P. van Rossum, Coordinates in two variables over a Q-algebra, Trans. 
Amer. Math. Soc. 356 (2004), no. 5, 1691-1703. 

D. R. Finston and S. Walcher, Centralizers of locally nilpotent derivations, J. Pure Appl. 
Algebra 120 (1997), no. 1, 39-49. MR MR1466096 (98d:14057) 

G. Freudenburg, Triangulability criteria for additive group actions on affine space, J. Pure 
and Applied Algebra 105 (1995), 267-275. 

G. Freudenburg, Algebraic theory of locally nilpotent derivations. Invariant theory and alge- 
braic transformation groups VII., Encyclopaedia of Mathematical Sciences 136. 260 p., 2006 
(English). 

J. von zur Gathen, Functional decomposition of polynomials: the tame case, J. Symbolic 
Comput. 9 (1990), no. 3, 281-299. 

H. W. E. Jung, Uber ganze birationale Transformationen der Ebene, J. Reine Angew. Math. 
184 (1942), 161-174. 

S. Kaliman, Polynomials with general C 2 -fibers are variables, Pacific J. Math. 203 (2002), 
no. 1, 161-190. 

T. Kambayashi, On the absence of nontrivial separable forms of the affine plane, J. Algebra 
35 (1975), no. 449-456. 



14 



M. A. BARKATOU, H. EL HOUARI, AND M. EL KAHOUI 



[23] W. van dcr Kulk, On polynomial rings in two variables, Nieuw Arch. Wiskunde (3) 1 (1953), 
33-41. 

[24] C. M. Lam, V. Shpilrain, and J-T. Yu, Recognizing and parametrizing curves isomorphic to 

a line, To appear in J. Symbolic Computation (2007). 
[25] M. Miyanishi, Normal affine subalgebras of a polynomial ring, Algebra and Topological 

Thcorics-to the memory of Dr. Takehiko MIYATA, Kinokuniya (1985), 37-51. 
[26] V. L. Popov, On actions of G a on A", Algebraic groups Utrecht 1986, Lecture Notes in 

Math., vol. 1271, Springer, Berlin, 1987, pp. 237-242. 
[27] R. Rentschler, Operations du groupe additif sur le plan affine, C. R. Acad. Sci. Paris Ser. 

A-B 267 (1968), 384-387. 
[28] I. P. Shestakov and U. U. Umirbaev, The tame and the wild automorphisms of polynomial 

rings in three variables, J. Amer. Math. Soc. 17 (2004), no. 1, 197-227. 
[29] V. Shpilrain and J-T. Yu, Polynomial automorphisms and Grobner reductions, J. Algebra 

197 (1997), 546-558. 

[30] D. L. Wright, On the Jacobian Conjecture, Illinois J. Math 25 (1981), no. 3, 423-440. 

Laboratoire XLIM, UMR 6172 CNRS-Universite de Limoges, Avenue Albert- Thomas 
123, 87060, Limoges Cedex, France 

E-mail address: moulay.barkatouOunilim.fr 

Department of Mathematics, Faculty of Sciences Semlalia, Cadi Ayyad University, 
P.O Box 2390, Marrakech, Morocco 
E-mail address: h. elhouariOucam. ac .ma 

Department of Mathematics, Faculty of Sciences Semlalia, Cadi Ayyad University, 
P.O Box 2390, Marrakech, Morocco 
E-mail address: elkahouiSucam. ac .ma 



